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APPORTIONING A SHARED COMPUTER RESOURCE 



BACKGROUND 



The present invention relates to apportioning a shared 
computer resource . 

In computer systems, it is commonplace for multiple 
processes to require access to a shared resource which is 
capable of servicing only a single process during a time 
interval. Such shared resources include, for example, 
central processing units, memory, as well as other devices. 
A technique for controlling access to the shared resource is 
necessary to ensure effective use of the shared resource. 

In a known method, each of the multiple processes are 
assigned a relative priority which is used as the basis for 
apportioning access to the shared resource. Such a 
technique of allocating a priority to each of multiple 
processes, as well as apportioning the access of each 
process to the shared resource often results in less than 
optimal utilization of the shared resource, e.g., starvation 
of low-priority processes. 



Figure 1 depicts a computer-based shared memory system. 
Figure 2 illustrates a flow diagram illustrating an 
embodiment of the invention. 



A technique for controlling access to a shared computer 
resource by two or more computer processes requiring use of 
the shared computer resource is disclosed. The technique 
comprises the steps of controlling access to a shared 



BRIEF DESCRIPTION OF THE DRAWINGS 



DESCRIPTION AND PREFERRED EMBODIMENTS 
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computer resource by each of two or more computer processes 
requiring access to a shared computer resource by: 

assigning an access value and a relative priority value 
(such as "high" and "low" priority values) to each of the 
5 computer processes; 

and thereafter for each access cycle permitting each 
computer process access to the shared computer resource in 
accordance with each process' access value and relative 
priority value such that for each access cycle; 
10 providing access to each computer processes having 

pending high priority requests is provided access to the 
shared computer resource until the access value of each such 

y 

Q computer process is exhausted, and thereafter; 

'"J 

providing access to each computer process having 
15 pending low priority requests access to the shared computer 
'y^ resource until the access value of each such computer 

s; process is exhausted whereupon; 

1^ the access values of each computer process is 

reallocated by adding to any existing access value of each 
C3 20 process the access value originally assigned prior to any 
access cycle, and thereafter; 

any remaining pending requests for access present in 
any computer process are provided access to the shared 
computer resource as a low priority request until all 
25 pending requests for access to the shared computer are 
satisfied . 

As a further optional, but frequently desirable step, 
after all pending requests for access to the shared computer 
are satisfied, the access cycle is restarted. 
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Although this technique will be described with 
reference to the computer based shared memory system (100) 
shown on Fig. 1., the technique is applicable to many other 
systems both computer based, as well as non-computer based 
5 systems. As shown in Fig.l, the computer based shared 
memory system (100) includes a representation of multiple 
computer processes (110, 112, 114, 116), a memory controller 
(120), and as a shared resource, a shared memory bank such 
as a SDRAM memory bank (130) . While the present example 
10 illustrates SDRAM memory bank (13 0) as the shared computer 
resource, the techniques described herein may be used to 
improve the utilization of other types of shared computer 

«,3 resources (and non-computer resources) as well. Also, 

H 

^.,,| although the computer-based shared memory system (100) 



15 includes a representation of four computer processes, any 
■'==1 number of computer processes may benefit from the techniques 

described herein. 

The computer processes (110) and (112) can represent 
isochronous processes that require access to the SDRAM 



.1- 

ru 
m 

Q 20 memory bank (130) on a generally regular time interval. The 



computer processes (114) and (116) can represent 
asynchronous processes that may require access to the SDRAM 
memory bank (13 0) on a generally irregular time interval. 
In other implementations all of the computer processes can 

25 be of the same type (asynchronous, isochronous) . 

Each of the computer processes (110, 112, 114, 116) is 
assigned an access value. Each of the computer processes 
(110, 112, 114, 116) is assigned an access value which 
apportions the amount of access to the shared computer 

30 resource by the computer process, here a SDRAM memory bank 



— J 
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(130) . The access value assigned to each of the computer 
processes (110, 112, 114, 116) represents a portion of the 
total value provided by the shared computer resource, and 
may represent a fraction or proportion of the total value 
provided by the shared computer resource. The access value 
may be associated or represented by a counter which may be 
incremented when access values are allocated to the computer 
process, as well as decremented when the computer process is 
provided access to the shared computer resource. Each of the 
computer processes (110, 112, 114, 116) is also assigned a 
relative priority value, usually either a "high" or "low" 
priority value. Assignment of the access values and the 
priority value can take place at any time, but conveniently 
each be assigned at the initiation of a technique, or at a 
reset of the technique, or at the initiation or conclusion 
of an access cycle. Once these values are assigned, each of 
the computer processes may enter either a high priority 
request or a low priority request for access to the shared 
computer resource. These requests are received by the 
memory controller which arbitrates all the requests and 
provides access to the shared computer resource according to 
the following protocol. 

The memory controller evaluates the type of pending 
request, which is represented by the priority value of each 
computer process as well as the existing access value for 
each process. If the access value for each process is not 
zero, then the memory controller grants to each computer 
process having a pending "high" priority request access to 
the shared computer resource until the access value for each 
process is exhausted. The computer process is granted 
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access to the shared computer resource for an interval equal 
to its access value, and this is repeated for each of the 
remaining computer process having pending "high" priority 
requests. Subsequently, the memory controller determines if 
there are any pending "low" priority requests present. If 
none are pending, the access values for each computer 
process is reallocated by adding to any existing access 
value of each process the access value originally assigned 
prior to any access cycle. Optionally, but in most cases 
desirably, the process cycle is restarted. If however there 
are pending "low" priority requests present, then the memory 
controller grants to each computer process having a pending 
"low" priority request and whose access value is not zero 
access to the shared computer resource until the access 
value for each process is exhausted, and thereafter the 
access values for each computer process is reallocated by 
adding to any existing access value of each process the 
access value originally assigned prior to any access cycle, 
and thereafter if there are any remaining computer process 
having pending "high" priority requests whose requests were 
previously unsatisfied, they are treated as "low" priority 
requests and the memory controller grants to each computer 
process having such a pending "low" priority request and 
whose access value has • not been exhausted access to the 
shared computer resource until the access value for each 
process is exhausted. Thereafter, when all outstanding 
"high" priority and "low" priority requests have been 
satisfied, the access values for each computer process is 
reallocated by adding to any existing access value of each 
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process the access value originally assigned prior to any 
access cycle. 

In some implementations, only those pending requests 
present at the start of the process will be processed until 
all pending requests for access by two or more computer 
processes are satisfied, prior to the acceptance of and 
processing of new requests for access to the shared computer 
resource . 

In further implementations all pending requests for 
"high" priority access are satisfied, before pending 
requests for "low" priority access are given access to the 
shared computer resource. 

In another implementation, only those pending "high" 
priority and "low" priority requests present at the start of 
the process will be given access to the shared computer 
resource, wherein first all pending requests for "high" 
priority access are granted access for a time equal to their 
access values, after which all pending requests for "low" 
priority present at the start of the process are given 
access to the shared computer resource, for a time equal to 
their access values. In a variation on this 
implementation, after all pending requests for "high" 
priority access are granted access for a time equal to their 
respective access values, any unsatisfied pending requests 
for "high" priority access are recategorized as "low" 
priority requests, and/or new requests for access to the 
shared computer resource are accepted and recategorized as 
"low" priority requests, and then, all pending requests for 
"low" priority access are given access to the shared 
computer resource for a time equal to their access values. 
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Conveniently, each of the priority values and each of 
the access values are represented by an integer number, 
which facilitates incrementing and decrementing of the 
priority values and access values whenever access to the 
5 shared computer resource is provided by the memory 

controller in order to satisfy a pending request for access. 
Each of the priority values and each of the access values 
may be associated with a storage register, which itself is 
conveniently located with the memory controller, 
10 As shown in Figure 2, a technique (200) is initialized 

(202) whereby the priority value and access value for each 
of four computer processes (110, 112, 114, 116) have been 
established. Next, the pending request for each process as 
well as its priority value and access value are evaluated 
15 (204). Access to the shared computer resource (130) is 
granted to the first process which has a pending "high" 
SI priority request. Access is permitted (206) to the shared 

it computer resource (130) for an amount (i.e., time interval, 

number of processor clock cycles, etc.) based to the 
|;3 20 process' access value until the access value is decremented 
or otherwise exhausted. Following the permitted access, the 
status of any pending requests are evaluated to establish if 
there remain any pending "high" priority requests (208) , 
which have not exhausted their access valued, and if any 
25 such pending requests exist, access is permitted (206) to 
such processes. If no outstanding pending "high" priority 
requests remain, which indicates that all process having 
outstanding "high" priority requests have either been 
satisfied or have exhausted their access values, a 
30 determination (210) is made as to whether any "low" priority 
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requests are present and pending among the processes. If it 
is determined (210) that no "low" priority requests are 
pending, the access value for each process (110, 112, 114, 
116) is reallocated (212) by adding/ incrementing to any 
5 existing access value of each process the access value 
originally assigned prior to any access cycle, and the 
technique (200) may .repeat . Alternately, the technique may 
terminate (218) . However, if the determination (210) is 
made that "low" priority requests are present and pending 
10 among the processes, which have not exhausted their access 
values, access is permitted (214) to the shared computer 
resource for an amount (i.e., time interval, interval of 
processor clock cycles, etc.) based to the process' access 
value until the access value is decremented or 'otherwise 
15 exhausted. This evaluation is repeated until all pending 
''•J "low" priority requests are satisfied. If it is determined 

S3 

tic* 

(216) that no "low" priority requests are pending, the 
priority value and access value for each process (110, 112, 
I'y 114, 116) is reallocated (212) and the technique (200) may 

m 

Q 20 be permitted to repeat. Alternately, the technique may 
" terminate (218) . 

An illustrative example of technique is described as 
follows : 

^/^t^^ Four processes, eacli^ requiring access to a shared 

^25 computer resource, such a^a SDRAM bank are indicated as 
"A", "B", "C" and "D" , and tfce access value being 
represented as "a" for each pror;ess. It is to be understood 
that in this illustrative examplev each f the four processes, 
"A", "B", "C" and "D" have priority, values representing 
30 "high" priority. The process is initialized such that 
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Process X is provided access to the shared computer 
resource, EoH^wed by Process B, then Process C and finally 
Process D. In this example, the access values for Process A, 
B, C and D areVin a proportional ratio respectively having 
5 values of 1:1:4:2. Therefore, Process A should receive a 

maximum of 12.5% of available bandwidth. Process B a maximum 
of 12.5%, Process C^a maximum of 50% and Process D a maximum 
of 2 5% of available ba^ndwidth. In the following Table, the 
status of the access value of each of the processes. A, B, C 

10 and D are indicated per \^it interval of time, here 

indicated in 'clock cycles \. In the following Table, the 
access values for each process are represented by "a^" where 
"X" is the process A, B, C orXD. In this particular example 
each request for a service, such as access to a shared 

15 computer resource, requires foujNclock cycles to satisfy the 
request . 
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Table 1 



Clock 


A 


B 


c 


D 


Memory 


Comments 


1 


0 


0 


0 


0 


0 


Reset, set aA=t, aB=t, ac-4, o.z>=2 


2 


1 


1 


1 


. 1 


AO 


All the processes make request. A is first serviced 


3 


0 


1 


2 


I 


Al 


4 units of time to execute. 


4 


0 


1 


2 


2 


A2 


Decrement A's access value by 1 (aA= -1 ) 


5 


0 


1 


3 


2 


A3 


ctA=0, aB=l , ac=4, aD=2 


6 


0 


0 


4 


2 


BO 


B is serviced next 


7 


0 


0 


4 


2 


Bl 




8 


0 


0 


5 


2 


B2 


Decrement B's access value by 1 (030= ae -1) 


9 


0 


0 


5 


2 


B3 


ttA^O, aB=0, ac=4, a\y=2 


10 


0 


0 


4 


2 


CO 


C Is serviced next 


11 


0 


0 


4 


2 


CI 




12 


0 


0 


4 


2 


C2 


Decrement C's access value by 1 (ac= otc - I ) 


13 


0 


0 


4 


2 


C3 


aA=0, aB=0, ac=3, aD=2 


14 


0 


0 


3 


2 


CO 


C is serviced again, as it still has not exhausted its access 


15 


0 


0 


3 


2 


CI 


value 


16 


0 


0 


3 


3 


C2 




17 


0 


0 


3 


3 


C3 


aA=0, ae-O, ac-2, au=2 


18 


0 


0 


2 


3 


CO 


C Is serviced again, as it still has not exhausted its access 


19 


0 


0 


2 


3 


CI 


value 


20 


0 


0 


2 


3 


C2 




21 


0 


0 


2 


3 


C3 


aA~0, Qb-O, ac= 1 , ccd=2 


22 


0 


0 


1 


3 


CO 


C is serviced again, as it still has not exhausted its access 


23 


0 


0 


2 


3 


CI 


value 


24 


0 


0 


2 


3 


C2 


New request arrives at C, but it is not processed 


25 


0 


0 


2 


3 


C3 


aA=0, aB~0, ac-O, ao=2 


26 




0 


2 


2 


DO 


C's access value is exhausted, so D is serviced 


27 




0 


2 


2 


Dl 


New request arrives at A, but it is not processed 


28 




0 


2 


2 


D2 




29 


1 


0 


2 


2 


D3 


aA=0, aB=0, ac=0, aD= 1 


30 


1 


0 


3 


1 


DO 


A and C do not get access, but D continues to get access 


31 


1 


0 


3 


1 


Dl 


Since its access value is non-zero. 


32 


1 


0 


3 


1 


D2 




33 


1 


1 


3 


1 


D3 


aA=0, aB=0, ac=0, aD=0 


34 


0 


1 


3 


2 


AO 


A wins as Low Priority request, and the access values of each 
process are reallocated by adding to the existing access values the 
originally apportioned access values so that now: aA=l, ae^l, a<r=4, 
ao=2 


35 


0 


1 


4 


2 


At 




36 


0 


1 


4 


2 


A2 




37 


0 


1 


4 


2 


A3 


a^-O, aB= 1 , ac=4, aD=2 


38 


0 


0 


4 


2 


BO 




39 


0 


0 


4 


2 


Bl 




40 


0 


0 


4 


2 


B2 




41 


0 


0 


4 


2 


B3 


otA=0, aB=0, ac=4, aQ=2 


42 


0 


0 


3 


2 


CO 




43 


0 


0 


3 


2 


CI 




44 


0 


0 


3 


2 


C2 




45 


0 


0 


4 


2 


C3 


o.A=0, aB=0, ac=3, aD=2 


46 


0 


0 


3 


2 


CO 




47 


0 


0 


3 


2 


CI 




48 


0 


0 


3 


2 


C2 




49 


0 


0 


3 


2 


C3 


aA=0, aB=0, ac-2, ao-2 



As is seen from Table 1, the technique ensures that all 
initial pending requests for access to the shared computer 
resource have been addressed and satisfied, prior to the 
processing of later-received requests (see Clock #24, and 
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#27) which, due to the non-existence of initially pending 
"low" priority requests, are handled by the process as "low" 
priority requests and processed subsequent to all initially 
pending high priority requests. 

A further illustration of the technique is described as 
follows : 

Six processes, each requiring access to a shared 
computer resource, such as a SDRAM bank are indicated as 
"A", "B", "C", "D", "E" and "F" . Each of A, B, C and D has 
associated priority value representative of "high" priority 
while processes E and F have an associated priority value 
representative of a "low" priority. Each of A, B, C, D, E 
and F also have associated therewith access value ("a"). In 
this example, the access values for Process A, B, C, D, E 
and F are established or initiated to have a ratio of 
1:1:4:2:0.5:0.5. It will be understood then that Process A 
should receive a maximum of 11.1% of available bandwidth, 
Process B a maximum of 11.1%, Process C a maximum of 44.4%, 
Process D a maximum of 22.2%, Process E a maximum of 5.5%, 
and Process F a maximum of 5.5% of available bandwidth. In 
Table 2, the status of the access value of each of the 
processes. A, B, C, D, E and F are indicated per unit 
interval of time, here indicated in 'clock cycles'. In 
the following Table, the access values for each process are 
represented by "a^," where "x" is the process A, B, C, D, E 
or F. In this particular example each request for a 
service, access to a shared computer resource, requires 
four clock cycles for each "high" priority request from a 
computer process (sometimes also referred to as a "client") 
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but only or two clock cycles for each "low" priority request 
in order to satisfy a particular request. 



Q 

I, c 

hi 

Z'.SS 
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Table 2 





A 


R 


c 


n 
u 


p 


I 


Memory 


Comments 




Q 


Q 




0 


0 




Q 


Reset, ctA~l, ocb~1, ctc~4, otD=2, o(,e=0.5, otF^O.5 


L 


1 
1 


1 
1 


1 
1 


1 


— — 


— — 


AU 


All the processes make request^ A wins. Each request takes 


J 


U 


1 
1 


z 


I 


— — 


— — 


A 1 


4 units of time to execute. E and F have requests pending. 


A 
*t 


U 


1 
1 


z 


Z 






A ") 


Decrement A's access value by 1 






1 


1. 

J 


z 


-j — 
— — 


-j — 
— 


A 1 


ttA— 0, aB~U otc^, otD~2, aE~0.5, aF=0.5 


o 




u 


A 


T 

Z 


— 




oU 


B is next provided 


7 




u 


A 


z 


— — 


— j — 



R 1 




Q 

6 


n 
U 


u 


5 


z 


— — 




tsz 


. _ 

Decrement B's access value by 1 


Q 




n 

U 




z 


— 


~1 — 



RT 


Qa— 0, ae-O, ctc-4, ci\)—l, aE-U.D, 


i u 


A 

u 


A 

u 


A 

4 


z 


— 


— ! — 


UU 


C is next provided access 


1 1 


A 

u 


A 

u 




z 


— 


— — 


1 

L- 1 




1 0 
1 z 


A 
\) 


A 

u 


A 


z 


— — 


— — 


y^i 


_ 

Decrement C's access value by 1 


1 


A 

V 


n 


A 
M- 


z 


— — 





r"i 


otA~0, ae-O, ac-J, otQ— z, aE-U.5, a[^U.5 


1 d 


A 
U 


A 

u 


1 
J 


9 
Z 


— — 


J — 


CU 


C is serviced again, as it has a remaining access value. 


1 K 

i J 


A 
U 


A 

u 


J 


9 
Z 






CI 




16 


0 


0 


3 


3 


1 


1 


C2 




\ 1 


0 


0 


3 


3 






C3 


aA=0, aB=0, ac=2, aD=2, aE=0.5, aF=0.5 


1 0 
1 0 


0 


0 


2 


3 






CO 




19 


0 


0 


2 


3 






CI 




20 


0 


0 


2 


3 




1 


C2 




21 


0 


0 


2 


3 






C3 


otA^O, aB=0, ac=l, o.xr'l, aE=0.5, aF=0.5 


22 


0 


0 


i 


3 






CO 




23 


0 


0 


2 


3 


— — 




CI 




24 


0 


0 


2 


3 




, 


C2 


New request arrives at C, but it is a non-initial process and is 
not provided access to the shared resource as this time 


25 


0 


0 


2 


3 






C3 


ttA^O, ttB^O, ac=0, aD=2, aE=0.5, aF^O.5 


26 


1 


0 


2 


2 






DO 


C's access value is exhausted, so D is serviced 


27 


1 


0 


2 


2 


■ 




Dl 


New request arrives at A, but as it is a non-initial process and 
is not provided access to the shared resource as this time 


28 


1 


0 


2 


2 






D2 




29 


I 


0 


2 


2 


, 


, 


D3 


ttA^O, ae-O, ac=0, ap^l, aE=0.5, aF=0.5 


30 


I 


0 


3 


1 


1 


1 


DO 


A and C do not get access to the shared resource, but D 
continues to get access as its access value is non-zero 


31 


1 


0 


3 


I 


1 


1 


Dl 




32 


1 


0 


3 


1 




1 


D2 




33 


1 


1 


3 


1 






D3 


aA=0, aB=0, ac=0, aD=0, aE-0.5, aF=0.5 all "high" priority 
processes have exhausted their access values; access by "low" 
priority processes is initiated 


34 


1 


1 


3 


1 


0 




HO 


E is the low priority client with the highest priority value, so it 
is given access to the shared computer resource; aE=0, aF=0.5 


35 


I 


1 


3 


1 


0 




EI 




36 


1 


1 


3 


1 


0 


0 


FO 


F wins the arbitration as the highest low priority process, with 
a non-zero access value; qe^O, af=0 


37 


1 


1 


3 


I 


0 


0 


Fl 




3o 


u 


I 


3 


2 


0 


u 


AO 


A wins as low priority client, and the access values are reset 
ctA=l, ctB=l, ctc=4, aD=2; aE=0.5, aF=0.5 


jy 


u 


1 


4 


z 


u 


u 


A 1 

A 1 




/I n 


u 


1 


4 


1 

z 


0 


0 


Az 




H 1 


A 

u 


1 
1 


A 
4 


9 
Z 


A 

u 


A 

u 


Aj 


Qa-O, Qb-U ac=4, ao=2, an-O.S, aF=0.5 




u 


C\ 

u 


4 


2 


0 


0 


BO 




/I T 


0 


0 


4 


2 


0 


0 


B 1 




/I /I 


u 


u 


4 


2 


0 


0 


B2 




45 


0 


0 


4 


2 


Q 


0 


B3 


Ua V;, Ub~^, Otc~4, OtD~-^; Ot,E— U.J, OLf—V.j 


46 


0 


0 


3 


2 


0 


0 


CO 




47 


0 


0 


3 


2 


0 


0 


CI 




48 


0 


0 


3 


2 


0 


0 


C2 




49 


0 


0 


4 


2 


0 


0 


C3 


aA=0, aB=0, ac=3, aD=2, aE=0.5, aF=0.5 


50 
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As is evident from Table 2, the technique ensures that 
all initial pending "high" priority requests for access to 
the shared computer resource have been addressed, prior to 
the processing of initially pending "low" priority requests 
5 ( "E" and "F") or later-received non- initially pending 

requests of "A" and "C" (see clock #24, and #27). Also as is 
evident from Table 2, according to the inventive technique, 
the initially pending "low" priority requests ("E" and "F" ) 
ensured access to the shared computer resource before the 
10 later-received non- initially pending requests of the "high" 
priority clients which are converted to "low" priority 
requests. As disclosed on Table 2, each of the processes, A, 
B, C, D, E and F are ensured access to the shared computer 
resource . 

15 It is to be understood that while the process described 

above has been described in Fig. 1 and Table 1 with respect 
to a computer based shared memory system includes a 
representation of four computer processes (110, 112, 114, 
116) , a memory controller (120) and as a shared resource, a 

20 bank of shared memory, here a bank of SDRAM memory (130) , it 
is to be understood that the process is not limited to use 
with any particular hardware or software configuration, as 
it finds applicability in any computing or processing 
environment where two or more processes require access to a 

25 common shared resource. The process may be implemented in 
hardware, or in software, or in any combination of hardware 
and software. The process may be implemented in computer 
programs executing on programmable computers that each 
include a processor, a storage medium readable by the 

30 processor (including volatile memory, non-volatile memory, 
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and/or other storage medium) , at least one input device, and 
at least one output device. Such computer programs 
implementing the process may be implemented in a high level 
procedural language, in an object-oriented programming 
language, or in a low- level programming language such as 
assembly or machine language. The language may be a 
compiled or an interpreted language. The computer programs 
implementing the process may be stored on a storage medium 
or device (e.g., CD-ROM, DVD, magneto-optical disk, magnetic 
disk such as a hard disk, diskette, ROM, EEPROM, EPROM, 
etc.) that is readable by a general or special purpose 
programmable computer for configuring and operating the 
computer when the storage medium or device is read by the 
computer in order to perform the process described herein. 
The process may also be implemented as a computer-readable 
storage medium, configured with a computer program, where, 
upon execution, instructions in the computer program cause 
the computer or other computing machine to operate in 
accordance with the program. 

The technique described here can provide fair and 
guaranteed access to a shared computer resource by multiple 
processes, so that no process will be wholly foreclosed from 
access to the shared computer resource. Other 
implementations are also possible, and fall within the scope 
of the following claims. 




